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DETAILED ACTION 



Response to Arguments 
1 . Applicant's arguments filed 5/1 5/06 have been fully considered but they are not persuasive as 
to claims 1-17, 63 and 67. 

For claim 1, the applicant argues that the judging circuit of Okada et al. U.S. Patent 
6,226,086 and the judgment unit of claim 1 are completely different, because the judging 
circuit of Okada (10) judges of a camera moving amount (dx, dy) is larger than a 
predetermined threshold, while the judgment unit of claim 1 judges if the pixel shift on the 
actual completed merged image has been performed correctly or not (See Applicant's 
Remarks/Arguments, page 5, lines 15-20). 

The examiner disagrees. The claim 1 is written broadly. The claim 1 does not require 
the judgment unit judges if the pixel shift on the actual completed merged image has been 
performed correctly or not. The claim 1 only need " a judgment unit which judges whether 
the pixel shift photography has been normally performed or not, based on the image data 
for a plurality of images output before and after the displacement of said image sensing 
unit". The Okada reference clearly discloses in Figures 4, 10 and 12, the image memory 
(31) for storing the image data A (e.g., image data A is considered as "image output before 
the displacement), image memory 32 for storing the image data B (e.g., image data B is 
considered as "image output after the displacement as shown in Figure 4). The moving 
amount is detected based on the amount of motion vector between the image data A and B by 
detecting unit 9 (see Col. 14, lines 50-67 and Col 15, lines 1-13). In Figure 13, when the 
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moving amount dx > l/10Px and dy>l/10Py, the pixel shift photography has been judged as 
unnormal so that the image synthesizing circuit 6 have to perform an additional operation 
such as interpolating image data as correction for forming a high-resolution synthesized 
image (See CoL 15, lines 50-65). 



Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1-7, 9-13, 63 and 67 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Okada et al. U.S. Patent 6,226,086 in view of the applicants' admitted prior art. 

Referring to claim 1, the Okada reference discloses in Figures 4, 10 and 12, an image 
input unit capable of performing pixel shift photography, said image input unit comprising: a 
photographic optical system (optical series 2, See CoL 12, lines 42-43) which forms an image 
of a subject in a predetermined position; an image sensing unit (solid-state imaging element 
5, see Col. 12, line 45) which generates image data corresponding to the image of the subject; 
a pixel shift mechanism (3 and 4, see Col. 12, line 44) which displaces a subject image by a 
predetermined amount relatively with respect to the image sensing unit (5) as shown in 
Figure 4 (See Col. 6, lines 38-67); a pixel shift mechanism control unit (control circuit 8) 
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which controls said pixel shift mechanism so as to displace the image of the subject by the 
predetermined amount (e.g., Xr=l/2Px, Yr=l/2 Py, see Col. 7, lines 31-35); an image 
combining unit (image synthesizing circuit 6, see col. 12, lines 57-67) which generates image 
data for one image (synthetic image) by combining the image data for a plurality of images 
output before (e.g. image A is the image before the displacement) and after (e.g., image B is 
the image after the displacement considered as final picture) the displacement; and a 
judgment unit (e.g., operation judging circuit 10, see Col. 13, lines 1-8) which judges 
whether the pixel shift photography has been normally performed or not, before and after the 
displacement as shown in Figures 4, 12 and 13 (e.g., the Figure 12 clearly shows the image 
memory 3 1 for storing the image data A, image memory 32 for storing the image data B. The 
moving amount is detected based on the amount of motion vector between the image data A 
and B by detecting unit 9, see Col. 14, lines 50-67 and Col 15, lines 1-13. In Figure 13, when 
the moving amount dx > l/10Px and dy>l/10Py, the pixel shift photography has been judged 
as unnormal so that the image synthesizing circuit 6 have to perform an additional operation 
such as interpolating image data as correction for forming a high-resolution synthesized 
image, see Col. 15, lines 50-65). However, the Okada reference does not explicitly show the 
shift mechanism displacing the image-sensing unit instead of displacing the transparent 
planes 3a and 4a. 

The applicants 5 admitted prior art teaches in Figure 27A-C, three typical examples for the 
conventional image shift mechanism, the Figure 27A shows a CCD shift method, the Figure 
27B shows a LPF gradient method and the Figure 27c shows a lens shift method. The 
applicants' admitted prior art is evidence that one of ordinary skill in the art at the time to see 
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more advantages the image input device having more flexible methods to perform the pixel 
shift photography so that the desired image quality can be obtained easily (See applicants 5 
specification, page 2, line 19 through page 3, line 20). For that reason, it would have been 
obvious to one of ordinary skill in the art to modify the image input unit of Okada ('086) by 
providing the shift mechanism displacing the image-sensing unit for obtaining high quality 
image as taught by applicants' admitted prior art. 

Referring to claim 2, the Okada reference discloses wherein said judgment unit (10) 
comprises: a pixel shift evaluation value calculation unit (motion vector calculator 33, see 
col. 14, lines 56-61) which calculates a pixel shift evaluation value forjudging whether the 
pixel shift photography has been normally performed or not as shown in Figure 13, based on 
the image data for a plurality of images output before (e.g., image A) and after (e.g. image B) 
the displacement of said image sensing unit (See applicants 5 Figure 27A); and a pixel shift 
photography judgment unit (judgment circuit 10) which judges whether the pixel shift 
photography has been normally performed or not, based on the pixel shift evaluation value 
calculated by said pixel shift evaluation value calculation unit as shown in Figure 13. 

Referring to claim 3, the Okada reference discloses wherein said pixel shift evaluation 
value calculation unit calculates an amount of shift between the image data for the plurality 
of images output before and after the displacement of said image sensing unit (e.g., amount 
motion vector between image A and image B, see Col. 4, lines 49-62), as the pixel shift 
evaluation value; and said pixel shift photography judgment unit judges whether the pixel 
shift photography has been performed normally, based on the amount of shift calculated by 
said pixel shift evaluation value calculation unit as shown in Figures 10 and 13. 
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Referring to claim 4, the Okada reference discloses wherein when calculating the amount 
of shift between the image data for the plurality of images, said pixel shift evaluation value 
calculation unit calculates each amount of shift (e.g., X=Xr+dx and Y=Vr+dy) for a plurality 
of areas of the image data as shown in Figure 4. 

Referring to claim 5, the Okada reference discloses wherein said pixel shift photography 
judgment unit judges that the pixel shift photography has been performed normally when a 
part of or the whole of the amount of shift in the plurality of areas calculated by said pixel 
shift evaluation value calculation unit is within a predetermined range as shown in Figure 1 3 
(e.g., whether or not the moving amount is great than a predetermined value, see Col. 15, 
lines 1-13). 

Referring to claim 6, the Okada reference discloses wherein said pixel shift photography 
judgment unit judges that the pixel shift photography has not been performed normally when 
a part of or the whole of the amount of shift in the plurality of areas calculated by said pixel 
shift evaluation value calculation unit is out of the predetermined range (when the moving 
amount is great than a predetermined value, dx>l/10Px, or dy>l/10Py) and there is a 
predetermined relation in the amount of shift in the plurality of areas as shown in Figure 13. 

Referring to claim 7, the Okada reference discloses wherein said pixel shift photography 
judgment unit judges that the pixel shift photography has been performed normally, but a 
part of the subject has moved (e.g., the image subject has moved by an unstable vibration as 
blurring), in the case where a part of or the whole of the amount of shift in the plurality of 
areas calculated by said pixel shift evaluation value calculation unit is out of the 
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predetermined range, but there is no predetermined relation in the amount of shift in the 
plurality of areas as shown in Figure 13, steps S33-S34. 

Referring to claim 9, the Okada reference discloses wherein said pixel shift evaluation 
value calculation unit calculates the coincidence degree (by using point matching method is 
considered as calculating the coincidence degree for detecting amount of moving, see Col. 
14, lines 5 1-62) for a target image data, based on an image data output by said image sensing 
unit before and after being displaced, as the pixel shift evaluation value; and said pixel shift 
photography judgment unit judges whether the pixel shift photography has been performed 
normally, based on the coincidence degree calculated by said pixel shift evaluation value 
calculation unit as shown in Figure 13. 

Referring to claim 10, the Okada reference discloses wherein said pixel shift evaluation 
value calculation unit calculates the coincidence degree, respectively, for the plurality of 
areas (each pixels in the image plane) of the image data, at the time of calculating the 
coincidence degree as shown in Figures 18-20. 

Referring to claim 1 1 , the Okada reference discloses wherein said pixel shift photography 
judgment unit judges that the pixel shift photography has been performed normally when a 
part of or the whole of the coincidence degree (pint matching) in the plurality of areas 
calculated by said pixel shift evaluation value calculation unit (9) is within a predetermined 
range (1/lOPx, or l/10Py). 

Referring to claim 12, the Okada reference discloses wherein said pixel shift photography 
judgment unit judges that the pixel shift photography has not been performed normally when 
a part of or the whole of the coincidence degree (point matching for calculating the amount 
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of motion vectors) in the plurality of areas calculated by said pixel shift evaluation value 
calculation unit is out of the predetermined range, and there is a predetermined relation in the 
coincidence degree in the plurality of areas as shown in Figure 13. 

Referring to claim 13, the Okada reference discloses wherein said pixel shift photography 
judgment unit judges that the pixel shift photography has been performed normally, but a 
part of the subject has moved (e.g., the image subject has been moved by an unstable 
vibration as blurring), in the case where a part of or the whole of the coincidence degree 
(point matching for calculating the amount of motion vectors) in the plurality of areas 
calculated by said pixel shift evaluation value calculation unit is out of the predetermined 
range, but there is no predetermined relation in the coincidence degree in the plurality of 
areas as shown in Figure 13, steps S33-S34. 

Referring to claim 63, the Okada reference discloses all subject matter as discussed with 
respected same comments to claim 1 . 

Referring to claim 67, the Okada reference discloses all subject matter as discussed with 
respected same comments to claim 1 . 

4. Claims 8, 14 and 16-17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Okada et al. U.S. Patent 6,226,086 in view of the applicants' admitted prior art and Kondo et 
al. U.S. Patent 5,731,849. 

Referring to claim 8, the Okada reference and applicants' admitted prior art disclose all 
subject matter as discussed with respected to claims 1-4, and the Okada reference discloses 
the judgment unit (10) judges whether the pixels shift photograph has been performed 
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normally, based on the amount of shift in the plurality of areas and the motion vector. 
However, the Okada reference does not explicitly has a detail about the amount of the motion 
vectors related to the reliability evaluation data for indicating the reliability of each amount 
of shift in the plurality of areas. 

The Kondo reference teaches in Figure 1 , a motion vector detecting apparatus calculating 
the reliability of the motion vector which is detected in the plurality of areas and weighting 
process according to the reliability evaluation is executed to the movement vector when there 
is different motions inherent exist (See Col. 7, lines 53-67). The Kondo reference is 
evidence that one of ordinary skill in the art at the time to see more advantages the amount of 
the motion vectors related to the reliability evaluation data for indicating the reliability of 
each amount of shift in the plurality of areas so that the detection precision of the motion 
vector can be significantly improved and the vibration detection is optimized (See Col. 8, 
lines 20-33). For that reason, it would have been obvious to one of ordinary skill in the art to 
modify the image input unit of Okada ( c 086) by providing a reliability evaluation unit which 
calculates reliability data indicating the reliability of each amount of shift in the plurality of 
areas as taught by Kondo ('849). 

Referring to claim 14, the Okada, applicants' admitted prior art and Kondo references 
disclose all subject matter as discussed with respected same comments to claims 8 and 10, 
and wherein said judgment unit comprises a reliability evaluation unit which calculates 
reliability data indicating the reliability of each coincidence degree in the plurality of areas 
calculated by said pixel shift evaluation value calculation unit; and said pixel shift 
photography judgment unit judges whether the pixel shift photography has been performed 
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normally (e.g., depend on amount of moving), based on the coincidence degree in the 
plurality of areas and the reliability data as shown in Figures 13 and 18-20. 

Referring to claim 16, the Okada, applicants' admitted prior art and Kondo disclose all 
subject matter as discussed with respected same comments to claim 8, and the Kondo 
reference discloses wherein said reliability evaluation unit calculates the reliability data 
based on the contrast of the image within the range of each of the calculation area (e.g., 
judging an effective area is set to the peak center and a map having a weight coefficient 
distribution according to position information which occupies in the areas of each of the 
blocks, See Col. 7, lines 25-30 and Col. 8, lines 5-15). 

Referring to claim 17, the Okada and Kondo references disclose all subject matter as 
discussed with respected same comments to claims 14 and 16. 

5. Claim 15 rejected under 35 U.S.C. 103(a) as being unpatentable over Okada et al. U.S. Patent 
6,226,086 in view of the applicants' admitted prior art and Onuki U.S. Patent Publication 
2002/0097324. 

Referring to claim 15, the Okada reference and applicants' admitted prior art disclose all 
subject matter as discussed with respected to claim 1, except the Okada reference does not 
explicitly show an informing unit which informs of the judgment result of said pixel shift 
photography judgment unit. 

The Onuki reference teaches in Figure 46, an image sensing apparatus, which performs 
pixel shifting operation and including an informing unit (display) which informs (warning 
message) of the judgment result of the pixel shift photography judgment unit (e.g., when the 
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luring is large, a warning message is displayed when pixel shifting operation is determined, 
See page 29, paragraph [0054]). The Onuki reference is evidence that one of ordinary skill in 
the art at the time to see more advantages the image input unit including an informing unit 
which informs of the judgment result of said pixel shift photography judgment unit so that 
easily warning a user of an image not being obtained in desired resolution, or an alternative 
suggestion to be followed for improving resolution of the image and reducing the effect of 
movement of an object while performing pixel shifting (see page 3, lines 13-15 and [0031]). 
For that reason, it would have been obvious to one of ordinary skill in the art to modify the 
image input unit of Okada ('086) by providing an informing unit which informs of the 
judgment result of the pixel shift photography judgment unit as taught by Onuki ( c 324). 

Conclusion 

6. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy 
as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until 
after the end of the THREE-MONTH shortened statutory period, then the shortened statutory 
period will expire on the date the advisory action is mailed, and any extension fee pursuant to 
37 CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 
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7. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Lin Ye whose telephone number is (571) 272-7372. The examiner can 
normally be reached on Mon-Fri 8:00AM-5 :00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David L. Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status information 
for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access 
to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). If you would like assistance from a USPTO Customer Service Representative or 
access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 
571-272-1000. 
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Primary Examiner 
Art Unit 2622 



August 1,2006 



